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Abstract 

We show that any finite set of rank-one matrices satisfies the finiteness prop- 
erty under the framework of (invariant) extremal norm. Formula for the com- 
putation of joint /generalized spectral radius for this class of matrix family is 
derived. Based on this, we further study the joint/generalized spectral radius 
of finite sets of general matrices through constructing rank-one approximations 
in terms of singular value decomposition (SVD) and a new characterization of 
joint/generalized spectral radius is obtained. Several benchmark examples from 
applications as well as their computational simulations are provided to illustrate 
the theoretical outcomes. 
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1. Introduction 

The joint spectral radius of a finite set of matrices plays an important role in 
real applications. Among its large amount of various applications we identify the 
followingareas: wave- let theory [l|, Q, 0, 0, [B| , stability of switched linear systems 
@, 0, [Mill , subdivision algorithms for generating curves 1(J U | , overlap- free 



words [12| , asymptotic behavior of partition functions |13[ , and their references 
therein. Hence, the computation or approximation of joint spectral radius is of 
great interest in reality. 

We consider a finite set T — {Ai,A 2 , • • • , A m } C C nx " of complex n X n 
matrices and define the set Fk of all possible products of length k > 1 with 
factors from J 7 , i.e., 

Tk = {A n A l2 ■ ■ ■ A ik : 1 < ij < m, j = 1, . . . ,k} . 



*This work was supported by NSF 1021203 of the United States. 
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Let || • || be any sub-multiplicative matrix norm and p(A) be the spectral radius 
of a matrix A. The joint spectral radius (JSR) of introduced by Rota and 



Strang [141 ] . is defined as 



p(F)= Km maxPH 1 ^, 

and the generalized spectral radius of J 7 , initiated by Daubechies and Lagarias 
[H , is given by 

p(J") = limsup max p(A) 1 ^ k . 

fc-s-oo A ^k 

Since the equality /5(J-") = /5(.F) has been established for any finite set of matri- 
ces [H, [Til [13] , we shall not distinguish between them and designate an unified 
notation p{!F){— p{T) = ^(J 7 )) throughout the paper. Another equivalent vari- 
ational way of characterizing JSR is [14j 

p(^) = infmaxP||, (1) 

where the infimum is taken over the set of all sub-multiplicative matrix norms. 
Whenever the infimum in (fTJ) is attained (thus a minimum), the corresponding 
norm | • 1 1 * will be called an extremal norm [l8[ . The definition (TT]) is somehow 
attractive in the sense that its estimation of p(F) avoids the computation of 
long matrix products ifjl •_]]* is available and is computable in an efficient way. 

Earlier algorithms 19, 20] for computing or approximating the joint/generalized 
spectral radius mostly make use of the following three important inequalities 

max p(A) 1 ^ < p{F) < max \\Aff k (2) 

for any k > 1. In general, however, such a brute- force approach is far from 
satisfactory and the highly slow convergence in general renders this estimation 
impractical to many problems, in particular, for those large-scale ones. In order 
to obtain better approximations within current computational capacity, many 
numerical methods were proposed during last decade. We categorize them into 
two main approaches. 

The first approach is to try to construct the extremal norm || • ||* or to 
approximate it when it exists. One necessary and sufficient condition for the 
existence of an extremal norm is the non-defectiveness of the corresponding nor- 
malized matrix family j2l|, which is not algorithmically decidable j22|. In [23j |. 
the minimization was restricted to the set of ellipsoid norms, which can be effi- 
ciently approximated by current convex optimization algorithms. This approach 
provides a theoretical precision estimation of p(F) in limited applicable cases. 
In [2l[ [24], HBJ , the minimization was confined to the set of complex polytope 
norms. The successful construction of such a polytope norm is not guaranteed 
in general, and it is more suitable to be used to verify the occurrence of the 
finiteness property (FP) of T 26], that is, to check the case when there is a 
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positive integer t such that 

p{F) = p{A ll A l2 ---A lt ) 1 ' t 

for some finite product A^A^ ■ ■ ■ Ai t € Tt, and the corresponding product se- 
quence is called an optimal sequence. Within this framework, other special 
extremal norms, such as Barabanov norm (l8| . Optimal norm [27j |. etc. are 
also considered. Kozyakin in [28| considered an iterative algorithm which ap- 
proximates p(J^) through constructing a sequence of approximated Barabanov 
norms under the assumption of irreducibility, however, the computational cost 
is very high and the issue of estimating the convergence rate remains unsolved. 
The sum of squares method investigated in [29I ] was intended to approximate 
the extremal norm through a multivariate polynomial with norm-like quality 
under which the action of matrices becomes contractive. However, to obtain an 
analytic extremal norm expression is quite challenging and there seem no easy 
solutions so far. 

The second approach makes use of the cone invariance of a given matrix 
set T for computing its JSR when such a property exists |3(J. In 30l 31 [. an 
iterative algorithm building an approximated invariant set was developed, which 
for a fixed dimension demonstrates polynomial time complexity with respect to 
1/e, where e is a given accuracy. In [32J, Blondel and Nesterov introduced a 
Kronecker lifting based approximation to the JSR with arbitrary accuracy under 
the assumption of the existence of an invariant proper cone, which can always be 
assured via one step of semi-definite lifting with the cost of squaring the matrix 
dimension. The exact nature of this cone is irrelevant to the derived accuracy 
of estimation. Following this methodology, a new conic programming method 



was offered in |33j, which gives an improved accuracy estimation by taking the 
nature of cone invariance into the consideration. In general, the existence of 
an invariant cone is restrictive and may exclude many interesting cases in real 
applications. 

In numerical computation of joint/generalized spectral radius, criteria for 
determining if a given matrix family satisfies the FP can guide us to develop a 
decidable algorithm. The original finiteness conjecture [26| stated that the FP 
is true for any finite n X n real matrix family, which was recently proved to be 
false 34, 35, 36]. The existence of such counterexamples shows that the FP does 



not hold in general, however, it has been found since then that many classes 
of matrices possess this computationally favorable feature. In [23j], Blondel, 
Nesterov, and Theys proved the FP for the matrix family with a solvable Lie 
algebra and the matrix pair of form {^4, A T }. In [33|, the normal and commonly 
triangularizable matrix family were added into this list. Later on, a restricted 
version of finite conjecture claimed that the FP is true for every pair ofnxn sign- 
matrices [HI . The significance of this conjecture lies in its equivalence to the FP 
of all sets of rational matrices. Along this track, the case of 2 x 2 sign-matrices 
pair was proved in [39| with the exploration of real extremal polytope norms, 
but the similar conclusion for higher dimension remains unknown. Currently, 
the list of matrix families satisfying FP is still very short. 
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Rank-one matrices are the simplest class of matrices not only in theoretic 
analysis but also in algorithmic approximations for matrix computation since 
any matrix can be expressed in terms of the sum of a set of rank-one matrices, 
for example, in the singular value decomposition (SVD). Among all those illus- 
trative examples appeared in existing literature related to JSR, we observed that 
all the cases with only rank-one matrices satisfy the fmiteness conjecture. This 
motivates us to consider how to obtain the JSR of finite rank-one matrix family 
and then apply this finding to approximate the JSR of general matrix family. 
The main contributions of this paper are: (i) by making use of Barabanov norm 
and rank-one property, we show that any finite set of rank-one matrices satisfies 
the fmiteness property and the computation for its JSR is derived; (ii) based on 
the obtained result in (i), a new characterization of the JSR of general matrix 
family is obtained by exploiting the rank-one approximation based on SVD, 
which provides us a new computational scheme with some favorable numerical 
performance over existing algorithms. 

The paper is organized as follows. In section 2 we prove that a finite set of 
rank-one matrices possesses the fmiteness property and some important proper- 
ties for the computation of its JSR are given. In section 3, we further develop this 
idea in the study of general matrix family. A rank-one approximation scheme 
based on SVD for approximating JSR is developed and a new characterization is 
obtained. Further discussions for non-negative matrix family are also presented 
in this section. Several benchmark examples from real applications as well as 
their numerical simulations are presented in section 4. The paper ends with 
concluding remarks in section 5. 

2. Finite rank-one matrix family 

We first give some well-known properties of rank-one matrices, which will 
be employed in our subsequent derivations. Given a matrix A € C" x ™, we 
denote by rank(j4) and tr(A) the rank and trace of A, respectively. We know 
from linear algebra that rank(yl) = 1 if and only if there exist two nonzero 
vectors x,y £ C" such that A — xy* . Obviously, any rank-one matrix A has 
at most one nonzero eigenvalue, denoted by X(A) = y*x. In particular, the 
spectral radius of a rank-one matrix A is p(A) = |A(j4)| = |tr(A)|. For any two 
rank-one matrices A\ — x\y\ € £. nxn and A2 — 222/2 ^ C" x ™, the product 
A\Ai = x\y\xiy\ — (y\x2)x\y\ is at most rank-one. By a simple induction, 
arbitrary finite products of rank-one matrices remain at most rank-one. 

2.1. The JSR of finite rank- one matrix family 

In this subsection, we will show that any finite set T of rank-one matrices 
possesses the fmiteness property. If p{F) = 0, then by ([2]) it holds p(A{) = = 
p(F) for all I < i < m and so the fmiteness property is already true for T . 
Thus we will only consider p(J-) > case. 

Recall that a general matrix family J- is said to be irreducible provided 
all the matrices in T have no common non-trivial invariant linear subspaces 
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of C". The following lemma allows us to assume that T is irreducible in the 
following; for otherwise, we could first reduce T into several irreducible matrix 
families with smaller dimensions, and then carry out the same proof with each 
irreducible matrix family to draw the same conclusion. 

Lemma 1 ([HI]). For any finite matrix family T = {A\, A2, • ■ ■ ,A m } C C nxn , 
there exist a nonsingular matrix P £ C™ x « an d r positive integers {n\, ri2, • • • , n r } 
with m + ri2 + • • • + n r = n such that 



PA..P- 1 



A 



(i) 







A 



(2) 



A 



0) 



for 



1,2, •• • ,m, 



where J-^ := 
satisfying 



{A^,A^\- ■ ■ ,A ( „{'} C C"^ x ™^ is irreducible for j 
p(T) = max p(J*0). 

l<j<r 



Thus, without lose of generality, we may always assume the matrix family 
T being irreducible. This leads to an important connection between the joint 
spectral radius and a special induced matrix norm, called extremal norm (37j . 
Due to the irreducibility of J 7 , we can assume p(J~) — 1 by normalizing the 
matrix family T by l/p(J r ), and thus it guarantees that normalized T is non- 
defective, i.e., the semi-group of matrices generated by T is bounded, and hence 
there exists an (invariant) extremal norm for JF as described in next lemma. 

Lemma 2 ([Hj]). For any finite irreducible matrix family J 7 , there exists a 
vector (Barabanov) norm || • \\b such that: 

(1) For all v e C" and all A £ T it holds that \\Av\\ B < p^lHls, 

(2) For all v £ C™, there exists an A£ J- such that \\Av\\b = p(-7 r )|| u l|s- 

In particular, the induced matrix norm \\ ■ \\b is an extremal norm satisfying 

max \\A\\b = p(J-)- 

We are ready to prove the finiteness property of irreducible rank-one matrix 
family. 

Theorem 3. Let T = {Ai = Xiy* : i = 1, 2, • • • , m} C £ nxn be an irreducible 
rank-one matrix family. Then T has the finiteness property and the correspond- 
ing optimal product sequence of minimal length has distinct factors. 

Proof. We first normalize T such that p(J-) = 1. By Lemma [5J choose v £ C" 
with \\v\\b = 1, then for any k > 1 there exists a multi-index (i\, 12, ■ ■ ■ , ik) such 
that 



1 



\V\\b 



\ A h v \\B 



IA^A^vWb 



\\A lk ---A l2 A ll v\\B- 



(3) 
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By the pigeonhole principle, if k > (m + 1), then the multi-index (ii, i 2 , ■ ■ • ,h) 
has at least one repeated index. We define s to be the maximum of those 
fc's such that the corresponding multi- index (i-y, ig, • • ■ , ik) satisfying §3§ has no 
repetition. It's obvious that s < m. Then, choosing k = s + 1 in ([H) gives 
igjf-x = ij for some unique 1 < j < s, that is, 

1 = \\v\\b = ■■■ = \\Ai. ■■■A il v\\ B = ■■■ = \\A l3+1 A ls ■ ■ ■ A h ■■■A il v\\ B - 

Since Ai a+1 = Ai j is rank-one matrix, its range is one-dimensional and hence 

Ai 3 - ■■ A h v — az and A is+1 A is ■ ■ ■ A ij ■ ■ ■ A i± v = fiz 

for some 0^aeC,0^/}eC, and ^ z £ C" (we may choose z — x ij here). 
Then 

||az|| B = \\A tj ■■■A ll v\\ B = 1 = ||^ s+1 A is ■ ■ ■ A t] ■■■A tl v\\ B = \\(3z\\ B , 
which gives |a| = |/3|. Finally, we obtain 

f3z = A ia+1 A ia ■ ■ ■ A lj+1 (Aij ■■■A h v) = A ts+1 A ls ■ ■ ■ A i]+1 (az) 



and hence 



Ai s+1 Ai a ■ ■ ■ Ai j+1 z — — z, 



where — is an eigenvalue of Ai^ +l Ai s ■ ■ ■ Ai j+1 . Therefore, by Lemma [2] 

1 > \\A ts+1 A is ■ ■ ■ Ai J+1 \\ B > p(A ia+1 Ai s ■ --A lj+1 ) > |^| = 1, 

which proves that J- has the finiteness property with 

P (F) = 1 = P (A ls+1 A ls ■ ■ 
where 1 < (s — j + 1) < m and i s +i ^ i s =/=■■■ =/= ij+i by the choice of s. □ 

We remark here that Theorem |3] provides us a critical structure of an optimal 
sequence, which will greatly improve the efficiency of specially designed search 
algorithms. In particular, non-repeated index indicates that the lengths of all 
minimal optimal sequences will not be longer than m. In fact, the possible 
minimal optimal sequence with longest length is A1A2 ■ ■ ■ A m . In summary, 
an explicit the formula for the JSR of any rank-one matrix family is given by 
T = {A 1 ,A 2r -- ,A m }cC" x "as 

\<k< m J 

where J 7 ^,*' = {A il A i2 ■ ■ ■ A ik e Fk : i s 7^ H when s^f} denotes all possible 
products in Tu with distinct factors. 



Rank-one Approximation of Joint Spectral Radius 



7 



2.2. Two simple examples from current literature 

In this subsection, we verify our foregoing results by two toy examples. The 
formula (Q} provides a straightforward way to calculate the JSR for a rank- 
one matrix family. The search of all possible products with distinct factors of 
length not exceeding m is sufficient to obtain the exact value of p(F), however, 
most of current numerical approximation methods can only provide lower and 
upper bounds for JSR with no indication whether the JSR has been achieved. 
Moreover, our formula Q is fully validated by the reported optimal sequences 
for any pair of rank-one 2x2 sign- matrices in |39j . 

Example 1 ([39]). Consider the rank-one matrix pair 



1 



1 



-1 -1 

Applying the formula (j4]) to obtain 



1 
1 



p{T) = max max p{A) l ' k = max{p(Ai), p(A 2 ), p(A 1 Az) 1 ' 2 } = y/2. 



Kfc<2 



Ae.Fi 



While in [39( this was solved by constructing an extremal real polytope norm. 
Example 2 ((2lj). Consider the rank-one matrix family 



T 



At 



1 1 





,A 2 





1 1 



.A* 



i i 

1 1 

2 2 



,Aa 



Using the formula ((4]) to get 



p(T) = max max p{A) 1/k = 1. 

l<fc<4 Ae ^(-0 



-2 



The same conclusion was derived in [21( by observing relations among all ma- 
trices, whose approach is hard to be applied to general cases. 



3. Rank-one approximation of JSR 

Although the JSR formula for rank-one matrix family is now available, its 
applicability is highly restricted since rank-one matrix family rarely occurs in 
practice. Therefore, in following two subsections we develop an approxima- 
tion approach to expand its horizon of application. This method imitates the 
conventional definition of p{F) in terms of limit superior and provides a new 
viewpoint on the approximation of JSR. The main idea results from the fact 
that the rank of any matrix products for a give set of matrices does not increase 
as the multiplication continues. This property provides us a feasible approach. 
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3.1. General matrix family 

In this subsection, we will introduce a natural and insightful way of ap- 
proximating p(F) by utilizing previous results on rank-one matrix family. The 
key idea is to perform the rank-one approximation of Tk successively as k in- 
creases. Let A € C nxn , from its singular value decomposition (SVD) we have 
the following rank-one decomposition 



A = (TiUiV*, 



where a\ > a% > • ■ ■ > u n > are the singular values, Ui and Vi are the 
ith left and right singular vector respectively. The customary best rank-one 
approximation of A is trying to minimize \\A— R\\f over all rank-one matrices 
R, which is achieved by choosing R — aiuiv\ . For our approach, we will choose 
a special candidate, denoted by P(A), which maximizes the absolute value of its 
trace (or spectral radius), i.e., 

P(A) = <Ji>Ui>v*, — arg max |tr(o-jWjt;*)| = arg max \p(<JiUiV*)\ 

l<i<n l<i<n 

as the rank-one approximation of A. Clearly ov < u\ = ||^4||2- For the conve- 
nience of further discussion, we denote the element- wise rank-one approximation 
of 

T = {A u A 2 ,...,A m } c 



^nxn 



by 

P(F) = {P(A 1 ),P(A 2 ),...,P(A m )}, 

where P{Ai) is the rank-one approximation of Ai as defined above. Notice that 
P(Tk) is a finite rank-one matrix family, thus p(P(J-'k)) can be obtained by the 
formula ffl. Our next result needs the trace characterization of JSR by Chen 
and Zhou[4(| 

p(F) = limsup max |tr(A)| 1/fc . (5) 

Theorem 4. For any finite matrix family T — {^1,^2, . . . , A m } C C nx ™, there 
holds 

p{T) = limsup p{P{T k )) 1/k . (6) 

k— ¥ 00 

Proof. Let || • H2 denotes the spectral matrix norm. To derive our conclusion, 
we will prove (j6]) by validating two inequalities as shown below. 

Firstly, given any k > 1, for the finite rank-one matrix family P(J r fc), we 
have 

ofPfJfc)) = max max p(R) 1 ^ 1 , 
Fy V " i<i< m » ReP(F k )i H ( ' 

where m k is the cardinality of the set P(J r / c ). For any R £ P(Fk)i, there exist I 



Rank-one Approximation of Joint Spectral Radius 9 

matrices Bj(l < j < I) with each Bj 6 T% such that 

R=Il l j=1 P(B j )=U l j=1 a j u j v*, 

where P{Bj) = ajUjV* with <Xj < 1 1 -Sj- ] j 2 , Uj and are the corresponding left 
and right singular vectors. By Cauchy inequality there holds 

P {R) < U'^aj < n^H^Ha < ( max ||A|| 2 



for all R £ P(J-"fc);. Thus we have 



p(P(^fc)) < max (max |L4|| 2 ) = max ||A|| 

l<l<m k J AeF k 



which leads to 



i/fe 

limsupp(P(J' fe )) 1 / fe < limsup ( max \\A\\ 2 ) = p(T). (7) 



Secondly, for any k > 1, let 

Bk = arg max |tr(A)|. 
Upon expressing the SVD of Bk as 

n 

B k = ^(TjUjV*, 
i=\ 

the linearity of trace operator gives 



|tr(B fe )| < V \ti(a iUi v*)\ <n( max \tr{a lUl v*)\ = np{P(B k )) 

* — * \ l<i<n ] 



i=l 

Therefore, for k > 1 we have 



i/k 



p(P(n)) 1/k > p(P(B k )) 1/k > (n- 1 |tr( J B fc )|) 1/ ' ! = n~ x l k ( max |tr(A)| 

\AeFk 

which in together with the equality ([5]) gives 

/ \ 1/k 

limsupp(P(J r fe )) 1/fc > limsup7i _1/fe max |tr(A)| = p{F). (8) 



fe— fOO fe— fOO y^tE^/s 

Finally, combining ([7]) and (|H]) the proof is completed. □ 
The above result reveals that the rank-one approximation of a matrix family 
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will approximate its JSR in sense of limit superior. Observing the left and right 
singular vector pair of a normal matrix are orthonormal, the following result 
generalizes the one given by 37] on normal matrix family. 



Corollary 1. For any finite matrix family T — {A\, A 2 , . . . , A m } c C" 

there exists a sequence A^A^ ■ ■ ■ Ai j e Tj is normal, then p{F) > || A^ Ai 2 
In particular, if 



if 



■A, 



2 ■ 



\Ai 1 Ai 2 



■Ai 



2 



max 1 1 AIL 



1/3 



£/ien we have 



pin 



\ A- A 

I -^42 



•A- 



2 ■ 



Proof. We conduct the SVD for the matrix A = Ai x Ai 2 ■■■Ai j . This gives 
A = U DU* , where £/ is an unitary matrix, and D is diagonal. Now consider 
the sequence {A*}%L V Notice that A 1 = UD e U* and p{P(A e )) = \\A\\ e 2 . Thus 



limsupyo(P(7" fe )) 

k— ¥ 00 



1/fc 



>limsupp(P(A)) i ^-' = ||A|| 2 

l— >oo 



Vi 



According to Theorem 2] the conclusion thus follows. 



□ 



In order to demonstrate the effectiveness of our approach, let's consider the 
following well-known 2x2 irreducible matrix pair 



T 



A l 



,A 2 



with b > 0, which was recently employed to disprove the finiteness conjecture 
(35)]. The authors in 24 1 show by constructing an exact real polytope extremal 
norm along with computational investigation that p( J 7 ) = o~\ Vb when b S [| , 1] 
and the minimal optimal sequence is A\A 2 . 

Note that the SVD of A\ (calculated by Mathematica 8) is given by 



A x 



crx 






02 



[ux u 2 ] 

1+V5 _____ 

^2(5+^5) \/lO-2Vt 



[Vl v 2 \ 

1-V5 



5+V5 

and thus the SVD of A 2 is 



^(5 + V5) 



2 






V5-1 



V 10-2v^ 

M 5 + ^) 



1 + V__~ 

^2(5+75) 



5+^5 



A 2 = bA\ = [vx v 2 ] 



ba\ 






b<r 2 



\Ux u 2 



Direct calculation yields u*Ux — v\vi = 1 and fjui = u*Vx = -j^. Hence, the 
rank-one approximation of J- based on SVD is 



P(Ji) = P(F) = {o-xUxvl,bo-iVxu\} 
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According to (QJ, if b £ [1,1] then there holds 

p(P(J r i)) = max |<tiu*ui, bcriU*Vi, aiVby/ u\u\ ■ v\v\^ 
= cti -max j-^=,6-^=, \/&| =aiVb = p(J r ). 

Here only one step of rank-one approximation gives piJ 7 )- 

3.2. Nonnegative matrix family 

In numerical implementation, it would be more favorable to have a limit 
rather than a limit superior in (jS]) because the former can be evidently observed 
within sufficient steps of approximation. In this subsection, we are going to 
further develop the limit property for nonnegative matrix family. 

In this paper by the notation A > and A > we mean the matrix A is 
nonnegative and positive in entry-wise sense, respectively. Suppose the consid- 
ering matrix family T = {Ai, A%, . . . , A m } C R nxn is nonnegative, i.e., A; > 0, 
there is an elegant limit expression of JSR established by Blondel and Nesterov 

p{F) = lim pV*(Af* + ... + Al k ), (9) 

ft— >oo 

where Af fe represents the fc-th Kronecker power of A4. This expression will play 
an important role in our following approach. For square matrices of the same 
size, the following properties for Kronecker product can be found in a standard 
matrix analysis textbook: 

(i) (A* ® A 5 )(A S ® A t ) = (A;A S ) ® (AjA t ); 

(ii) tr (Aj 1 A,- 2 • • • A i J' 8fc = tr fc (A il A i2 ■ ■ ■ A ie ) for any positive integer k; 

(hi) (A l8fe )^ = (A^) l8fc for any positive integers k,£. 

Recall that a square matrix A > is called to be primitive if A^ > for 
some integer I > 1. It is easy to see that if A is primitive, then A® k is also 
primitive according to (hi). An important property for a primitive matrix is 
that its spectral radius can be expressed as 

p(A) = lim tr 1//fe (A fe ), (10) 

k— > 00 

instead of limit superior in general cases. 

Lemma 5. Let J 7 = {A±, ■ ■ • , A rn } C R nxn be a family of nonnegative matrices. 
If there exists an integer j > 1 such that A it A i2 ■ ■ ■ A^ G Tj is primitive, then 
for any k > 1 the matrix Af k + . . . + A® k is primitive. 
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Proof. Since A^Ai 2 ■ ■ ■ Ai j is primitive, there exists a positive integer £ such 
that 

{A lt A i2 ■■■A ij Y > 0. 
The conclusion follows from the observation 



f k + . . . + A® k )' 



> [(A n A i2 • • • A*.)®*]' = [(A 4l A t2 • ■■A lj Yf K > 0. 

□ 

The following lemma generalizes a recent result given by Xu |4l| . 

Lemma 6. Let J- = {A±, • • • , A m } C R nx ™ be a family of nonnegative matrices. 
If there exists an integer j >1 such that Aj x Ai 2 ■ ■ ■ Ai e Jj is primitive, then 
we have 

p(F) = lim max tr 1 /^/!). 
Proof. For any integers fc, i > 1, there holds 



tr 



(Af k + ... + A® k ) 1 



tr 



i.e. 



E (^•••A ii f 

E tr (A tl ---A H f k 
E tx k (A il ---A il ), 

l<ii ....,ii<m 

tr (Af k + ... + A® k ) 1 = E tr fc (A), 



where the cardinality of Ti is to'. This leads to 



tr 1 /' (Af fe + . . . + Af k ) 1 ] ^ < m 1 ^ f maxtr 1 /^) 



By assumption that Ai 1 Ai 2 ■ ■ ■ Ai j € .Fj is primitive for some j > 1, we know 
from Lemma [5] that Af fc + . . . + is primitive for all positive integer k. For 
a fixed fc > 1, by taking the limit inferior over I on both sides and noting ()10j) . 
we have 



P 



l/fe 



(Af fe + . . . + A® k ) < m 1/k liminf max far 1 /' (A). 



Now by letting k — > oo and utilizing (|9]) we obtain 

p(T) < liminf maxtr^^A). 
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By combining this with the known equality 



p{F) = lim sup maxtr 1 /^) 

i->oo AeJr ' 



we derive 



lim sup max tr 1 /^ A) — p(J-) < liminf max tr 1 /'^), 

which leads to the conclusion. □ 

Corollary 2. Lei T = {Ax, ■ ■ • , A m } C E nx ™ be a family of nonnegative ma- 
trices. If there exists an integer j > 1 smc/i i/iai Ai 1 A\ 2 ■ ■ ■ Ay € J 7 ? is primitive, 
then there holds 

p{F) = lim p(P(J- fe )) 1/fe . (11) 



A- 



Proof. Similar to the proof of Theorem [4] by repeating the argument in the first 
part it follows the inequality 

limsu P/9 (P(J- fc )) 1 / fc < p{F). (12) 

k— ¥oo 

While in the second part, we have 

l/k 



p{P(F k )) 1/k > n-^ k ^rnffl |tr(A)| 



for all k > 1 , taking the limit inferior on both sides and employing Lemma 1101 
gives 

f \ 1/k 

liminf p(P(J' fe )) 1 /' £ > hnx n~ 1/fe I max |tr(A)| = p{F). (13) 

k— >oo >-oo \ A£j-k J 

According to (p~2|) and (| 13[> . we thus have 



limsupp(P(J- fe )) 1 / fc < p(T) < liminf p(P(T k ))^ k , 

fe— ►oo >-oo 

which implies the conclusion. □ 

The primitive condition in Corollary [2] is verifiable in numerical computations 
since a nonnegative matrix A £ M. nxn is primitive if and only if A n ~ 2n + 2 is 
positive [13]. Moreover, such an approximation to JSR is earlier to be observed 
than the limit superior as k increases, which will be illustrated in following 
numerical examples. 
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4. Numerical examples 



To demonstrate the effectiveness of our proposed approach, we next present 
numerical simulations on several important examples from current literature. 
All experiments are performed on MATLAB 7.10 with a machine precision of 
10~ 16 . For k > 1, we denote 

PfeCF) = max \\A\\l /k , p k {T) = max p{A) l / k , and p k {T) = [p{P(T k ))] l/k . 

4-1- Generalized partition function 

In number theory, a long-lasting problem is to estimate the asymptotic 
growth of the generalized partition function / p , c (i) defined as the total num- 



ber of different p-adic expansions t = Y^°jLo c jP^ with Cj € {0,1,. 



,,c 



!}• 



It has been shown that for given positive integers p and c there exist positive 
constants C and 7 such that / p , c (i) > Ci 7 as t — » 00. Moreover, there is a 
procedure (l3j to construct a family of binary matrices T dependent on p and 
c with the relation p( J 7 ) = p 1 . 

In [33i | . a conic programming approach was proposed to approximate the 
JSR of this matrix family T of dimension 7x7 with (p, c) — (3, 14). In this 
case the matrix family is given by 



A.= 
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1 
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1 
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1 


1 












1 




1 
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1 



According to |33[ the estimated interval of p(J-) is given by [4.72,4.8], where 
the lower bound is attained by using the sequence A\Ai and the upper bound is 
searched through the conic algorithm among all possible matrix products within 
length k < 9. There is no indication what is the value of p(J~) in their approach. 
The first step rank-one approximation P(J r ) by formula gives 



p(P(J")) 4.7915415825, 

which falls into the interval [4.72,4.8]. The numerical values of f>k(J~), pfe(J r ), 
and pk (J 7 ) for k > 1 are plotted and shown in Fig. Q] and Table HJ respectively. 
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Table 1: The values of Pfc(-F), Pk(^)i Pk{^) with respect to k, (p,c) = (3, 14). 



k 


MJ 7 ) 


Pk{F) 




\p k (T)~ P ^(A 1 A 2 )\ 


1 


5.262878 


4.6690790883 


4.7915415825 


6.95e-02 


2 


5.046134 


4.7220451340 


4.7208642368 


1.18e-03 


3 


4.936157 


4.7122439907 


4.7216905518 


3.55e-04 


4 


4.881518 


4.7220451340 


4.7220575153 


1.24e-05 


5 


4.849140 


4.7164125255 


4.7220470073 


1.87e-06 


6 


4.827731 


4.7220451340 


4.7220461006 


9.67e-07 


7 


4.812488 


4.7180343424 


4.7220452529 


1.19e-07 


8 


4.801089 


4.7220451340 


4.7220451879 


5.39e-08 



Figure 1: The values of PkiJ 7 ), Pfe(-? r ), Pfc(^") with respect to k, (p, c) = (3, 14). 




46 , , , , , , , 

1 2 3 4 5 6 7 8 

k 



Notice that the product Ai^Ai is positive, according to Corollary[2j we know 
there holds limfc_ i . 00 pk ( J-) = p{J-)- Therefore, we also compute the absolute 
difference between Pk{F) and p 1 t 2 (AiA2), which provides strongly numerical 
evidence that A\A 2 is the optimal sequence of p(J-). 



4-2. Asymptotics of Overlap-free words 

A word on the binary alphabet {a, b} is said to be overlap-free if it has no 
subwords (or factors) of the form xwxwx, where x € {a, b} and w could be a 
word or empty. For instance, the word baabaa is overlap-free, but baabaab is 
not. The asymptotic growth of the number t; of binary overlap- free words of 
length I could be expressed in terms of the JSR of a matrix pair T as [l2[ 

limsup -^y = log 2 p(T), 
i^oo In I 
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where T = {A U A 2 } C {0, 1, 2, 4} 20x20 is given by 



Ai 



with sub-matrices 



and 



B = 



C 



D = 



'c 
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This problem was firstly considered in [l2[ and then in (3^], where both ellip- 
soidal norm approximation and conic programming approach produce the same 
bound, i.e., p(T) £ [2.5179, 2.5186], among all matrix products within the length 
k < 14. In particular, p(A 1 A 2 ) 1/2 « 2.5179 gives the lower bound. 

Moreover, the authors in [12( conjectured the sequence AiA 2 is the optimal 
sequence. The numerical values of /^(J 7 ), ^(J 7 ), and Pk{3~) are plotted and 
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presented in Fig. [5] and Table [3J respectively. By observing that 

|p fe (^)-p(A 1 A 2 ) 1 / 2 |<5xlO- 4 
when k > 9, it is reasonable to believe that their conjecture is true. 



Figure 2: The values of p^{T), /3fc(J r ), PkiJ 7 ) with respect to k. 




2 4 6 8 10 12 14 

k 



Table 2: The values of pj. ( T) , p^ ( T) , pk ( -F) with respect to fc. 







Pu{F) 




\p k (F) - p^AiA*)^ 


1 


5.896964 


2.4206250653 


1.0000000000 


1.52e- 


-00 


2 


3.309093 


2.5179340409 


2.4799585961 


3.80e- 


02 


3 


3.029307 


2.5048603453 


2.5279522425 


l.OOe- 


02 


4 


2.924657 


2.5179340409 


2.5459319895 


2.80e- 


02 


5 


2.841023 


2.5080155383 


2.5201385520 


2.20c- 


03 


6 


2.778162 


2.5179340409 


2.5268682549 


8.93e- 


03 


7 


2.736156 


2.5099337275 


2.5190358732 


1.10c- 


03 


8 


2.705763 


2.5179340409 


2.5199752844 


2.04e- 


03 


9 


2.687999 


2.5118420373 


2.5180910647 


1.57e- 


04 


10 


2.669268 


2.5179340409 


2.5184122994 


4.78e- 


04 


11 


2.654756 


2.5129654473 


2.5179476144 


1.36e- 


05 


12 


2.642173 


2.5179340409 


2.5180554550 


1.21e- 


04 


13 


2.632798 


2.5137397302 


2.5179399051 


5.86e- 


06 
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4-3. Matrix pair with a rank-one member 
Consider the matrix pair 



T 



It is easy to show that 



At 



1 * 
1 



,A 2 



max 

£>1 



V7 



V7 



1/9 



1 -1 
1 -1 



1.130819895422034 



with the optimal sequence AfA 2 . The numerical values of ^(J 7 ), pk{F), and 
pit (J 7 ) are plotted in Fig|3]and reported in Table [3j respectively. One can see 
that for small k, Pk{F) approaches p(T) much better than f>k{F) and pfe(J r ). 
Moreover, the approximation p${!F) does provide the exact value of p(F), be- 
cause A\ A 2 is rank-one. 



Figure 3: The values of p^{T), Pk(-F), Pki^ 7 ) with respect to k. 



-pk{T) 




4-4- An example with oscillated approximation 
Consider the matrix pair [43j 

The numerical values of pk(F), pkiJ 7 ), and Pk{^) are plotted and reported in 
Fig. [4] and Table HI respectively. Although this matrix family does not satisfy 
the assumption of Corollary[21 one can easily show that p(J-) = lim^oo pkiJ 7 ). 



1 

1 



,A 2 = 



1/2 
1/2 
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Table 3: The values of Pki-F) , Pk{-F) > Pk(p~) with respect to fc. 



k 


PkiJ 7 ) 


Pki?) 




\p k {F)-p{F)\ 


1 


2.000000 


1.0000000000 


1.1856953382 


5.49e-02 


2 


1.551714 


1.0000000000 


1.1634231348 


3.26e-02 


3 


1.419079 


1.0000000000 


1.1429810565 


1.22e-02 


4 


1.351138 


1.0319129405 


1.1253876915 


5.43e-03 


5 


1.307649 


1.0861809816 


1.1307916559 


2.82e-05 


6 


1.276412 


1.1119113517 


1.1288979596 


1.92e-03 


7 


1.252402 


1.1240880182 


1.1292099639 


1.61e-03 


8 


1.233124 


1.1293241815 


1.1297917288 


1.03e-03 


9 


1.217169 


1.1308198954 


1.1308198954 





10 


1.205486 


1.1302365536 


1.1308198954 





11 


1.201904 


1.1284843579 


1.1308198954 





12 


1.198889 


1.1260827492 


1.1308198954 





13 


1.194836 


1.1233372781 


1.1308198954 






This example illustrates that the assumption of Corollary [2] is sufficient but not 
necessary. 



Figure 4: The values of p^ (J 7 ) , p^ ( T) , pk ( J 7 ) with respect to k. 




5. Concluding Remarks 

The computation of joint /generalized spectral radius has been proven to 
be challenging and difficult in current literature since both of them are the 
characteristics of the worst-case operation count which usually grows faster than 
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Table 4: The values of pj. ( T) , Pk ( T) , pk (J 7 ) with respect to fc. 



k 


MJ 7 ) 


Pki?) 




IhiJ 7 ) - 


P{?)\ 


1 


1.000000 


1.0000000000 


0.5000000000 


5.00e- 


01 


2 


1.000000 


1.0000000000 


1.0000000000 







3 


1.000000 


1.0000000000 


0.7937005260 


2.06e- 


01 


4 


1.000000 


1.0000000000 


1.0000000000 







5 


1.000000 


1.0000000000 


0.8705505633 


1.29c- 


01 


6 


1.000000 


1.0000000000 


1.0000000000 







7 


1.000000 


1.0000000000 


0.9057236643 


9.43e- 


02 


8 


1.000000 


1.0000000000 


1.0000000000 







9 


1.000000 


1.0000000000 


0.9258747123 


7.41e- 


02 


10 


1.000000 


1.0000000000 


1.0000000000 







11 


1.000000 


1.0000000000 


0.9389309107 


6.11e- 


02 


12 


1.000000 


1.0000000000 


1.0000000000 







13 


1.000000 


1.0000000000 


0.9480775143 


5.19e- 


02 



any polynomial in terms of matrix sizes. To identify which class of matrix 
families has finiteness property may lead to various efficient algorithms which 
can reduce the computational cost in a significant way. 

In this paper, we show that any family of rank-one matrices possesses the 
finiteness property and an explicit formula of its joint /generalized spectral ra- 
dius is obtained. Furthermore, by making use the rank-one approximation based 
on the singular value decomposition, a new characterization of joint/generalized 
spectral radius is derived. Numerical simulations on several benchmark exam- 
ples from applications show great promise for our proposed approach as an 
alternative approximation to joint/generalized spectral radius. However, find- 
ing the theoretical convergence rate of our approach is still open. 

Acknowledgment. The authors would like to thank Ahmadi and Par- 
rilo for pointing out an error in section 2.1 of our earlier version posted on 
larXiv:1109.1356l 
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